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TEMPORAL DIFFERENCE STATISTICS COMPUTATION 

FOR EACH PIXEL, COMPUTE: 
INTENSITY OF Nth PERCENTILE 
OR 

FROM TEMPORAL DIFFERENCE IMAGE, COMPUTE: 
MEAN (MEASURE OF CENTRAL TENDENCY) 
AND 

STANDARD DEVIATION (MEASURE OF VARIATION) 
OPTION: SPATIALLY INTEGRATE RESULTS 



FIG. 5 



TEMPORAL 
DIFFERENCE Nth 
PERCENTILE IMAGE 



PARAMETERS: 
MEAN, STANDARD 
DEVIATION 



MODEL-BASED INCIDENT DETECTION 
SYSTEM WITH MOTION CLASSIFICATION 



Inventors: Michael P. Rigney, et ah 
Attorney Docket No.: 090936.0468 
Page 4 of 6 



24 



TEMPORAL 
DIFFERENCE 

Nth 
PERCENTILE 
IMAGE 



PARAMETERS: 
TEMPORAL 

DIFFERENCE 

MEAN, 
STANDARD 
DEVIATION, 
MINIMUM 

THRESHOLD 



TEMPORAL • 
DIFFERENCE IMAGE 



LOW-LEVEL MOTION DETECTION 

1) SEGMENT MOVING OBJECTS FROM BACKGROUND 
(THRESHOLD TO CREATE BINARY IMAGE): 

OPTION A - LOCAL TEMPORAL AUTOMATIC THRESHOLD : 
PIXELS GREATER THAN ASSOCIATED TEMPORAL 
DIFFERENCE PERCENTILE IMAGE PIXEL ARE PART OF 
DETECTED MOVING OBJECTS 

OPTION B - GLOBAL TEMPORAL AUTOMATIC THRESHOLD 
PIXELS GREATER THAN MEAN + X STANDARD 
DEVIATIONS OF THE TEMPORAL DIFFERENCE IMAGE 
INTENSITY DISTRIBUTION ARE PART OF DETECTED MOVING 
OBJECTS 

2) PERFORM SPATIAL CONNECTIVITY ANALYSIS TO GROUP 
MOTION PIXELS INTO MOTION OBJECTS 



25 

<L 

LOW- 
LEVEL 
DETECTED 
MOTION 
IMAGE 



FIG. 6 



25 



LOW-LEVEL 
DETECTED 
MOTION IMAGE 



23 



IMAGE BEING 
ANALYZED (t 0 ) 



PARAMETERS: 
SPATIAL FILTER 
MORPHOLOGICAL 
FILTER SPATIAL 

FEATURE LIST 



SPATIAL DOMAIN ANALYSIS 

1) FILTER DETECTED MOTION OBJECTS BASED ON 
BINARY OBJECT FEATURES 

A. EXTRACT FEATURES FROM MOTION OBJECTS (SIZE, 
SHAPE, POSITION, ... ) 

B. DELETE NOISE OBJECTS BASED ON EXTRACTED 
FEATURES 

C. CLASSIFY OBJECT TYPE BASED ON EXTRACTED 
FEATURES 

2) FILTER DETECTED MOTION OBJECTS BASED ON 
OBJECT FEATURES FROM ORIGINAL SENSOR IMAGE 

A. EXTRACT OBJECT FEATURES FROM ORIGINAL GRAY- 
LEVEL OR COLOR IMAGE (INTENSITY DISTRIBUTION, 
TEXTURE, MOMENTS, THERMAL EMISSION PAIR, ... ) 

B. CLASSIFY OBJECT TYPE BASED ON EXTRACTED 
FEATURES 

FIG. 7 



71 

Z_ 

OBJECT 
FEATURE 

LIST 
(VECTOR) 



TEMPORAL 
BUFFER OF 
OBJECT 
FEATURES 




SPATIAL- 
FILTERED 
DETECTED 
MOTION 
IMAGE 



MODEL-BASED INCIDENT DETECTION 
SYSTEM WITH MOTION CLASSIFICATION 

Inventors: Michael P. Rigney, et a!. 
Attorney Docket No.: 090936.0468 
Page 5 of 6 



FIG. 8 



TEMPORAL 
BUFFER OF 
OBJECT 
FEATURES! 



PARAMETERS: 
CONTINUITY 
DILATION/ 
EROSION 
TRACKING 
TEMPORAL 
SIGNATURES 



TEMPORAL DOMAIN ANALYSIS 

PERFORM MOTION OBJECT CLASSIFICATION OR REMOVAL 
USING THE FOLLOWING OPERATIONS: 

1) TEMPORAL CONTINUITY. DETECT PERSISTANCE OF 
OBJECT. SPURIOUS SIGNALS AND NOISE WILL NOT 
HAVE TEMPORAL PERSISTANCE. MOVING OBJECTS WILL 
BE PERSISTANT BUT OFFSET IN POSITION 

2) TEMPORAL DILATION AND EROSION. DETECT 
PSEUDO-STATIONARY MOVING OBJECTS (FOLIAGE, 
FOLIAGE SHADOWS, BLINKING LIGHTS). CAN BE USED 
TO DETECT AND DISREGARD MOTION OBJECTS AND 
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3) OBJECT TRACKING. DETERMINE 
CORRESPONDENCE MAPPING OF OBJECTS THROUGH 
IMAGE SEQUENCE (TIME) 

4) TEMPORAL SIGNATURE ANALYSIS 

A. FREQUENCY MEASUREMENT. DETERMINE 
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